IT  FILE  COPY 


I 

I 

I 


dt  ic 

ELEC  :  £ 
MAR  2  71981  ! 


W 


Approved  for  nnb7  f « 
Oistrow  puniI°  release  • 

oiatributionunlifflited. 


Virginia  Polytechnic  Institute 
and  State  University 

Human  Factors  Laboratory 
Industrial  Engineering  and  Operations  Research 
BLACKSBURG,  VIRGINIA  24061 

81  8  87  017 

_ _ _ *  _ 23B 


f  tr|CATi0N  °r  THiS  PAC»F  f Wh*n  nnt^Entvf.l) 

x  Report  documentation  page 


W 


POUT  NUMBER 


OSR-TR-  31  -030? 


ll 


4.  TITLE  (and  Submit) 

QUALITY  METRICS  OF  DIGITALLY  DERIVED  IMAGERY  AND 
THEIR  RELATION  TO  INTERPRETER  PERFORMANCE 


INSTRUCTIONS 
IIEI  OUE  COMPLRTINC,  l-’ORM 


3.  RECIPIENT’S  CATALOG  NUMBER 


S.  PERFORMING  ORG.  REPORT  NUMBER 


7.  AuTHORf»J 


Harry  L.  Snyder,  Ph.D. 


4.  CONTRACT  OR  GRANT  NUMBERftJ 

F49620-78-C-0055/Le*t> 


9.  PERFORMING  ORGANIZATION  NAME  ANO  AOORESS  >0.  PROGRAM  ELEMENT.  PROJECT.  TASK 

_ ^  T  .  .  •  ,  — ,  ,  .  ,  „  .  ARE  A  4  WORK  UNIT  NUMBERS ' 

Department  of  Industrial  Engineering  &  Operations  6 1 1 02 F 
Research,  Virginia  Polytechnic  Institute  and  State  2313  A4 
University,  Blacksburg,  VA  24061 


11.  CONTROLLING  OFFICE  NAME  ANO  AOOR  -SS 


1Z.  REPORT  DATE 


U.S.  Air  Force  Office  of  Scientific  Research  (NL)  02E’/i<s:? 

Life  Sciences  Directorate  d.  number  of  pages - 

Bolling  AFB,  D.  C.  20332  Jo 


14.  MONITORING  AGENCY  NAME  4  ADDRESSfff  dlllerent  from  Conlro/Un*  Ollice)  IS.  SECURITY  CLASS,  (ol  thi,  report) 

unclassified 


IS.  OISTRlBUTIo»i-ir»£F.MENT  (ol  thlt  Roport) 


IS*.  OECLASSIFICATION'  DOWNGRADING 
SCHEDULE 


Approved  for  public  release;  distribution  unlimited. 


IT.  DISTRIBUTION  STATEMENT  (ot  the  ebttrect  entered  In  Block  20,  II  dlllerent  from  Report) 


If  KEY  WOROS  (Continue  on  tevetee  tide  tl  nor e***ry  end  Identity  by  block  number) 


Image  quality  image  processing 

Photointerpretation 

Human  factors 

Cathode  ray  tube  displays 

Film  displays 


20.  ABSTRACT  fConflnuo  on  rtv*r»»  tide  II  n+ceteety  end  Identity  by  block  number) 

^Yhis  annual  report  describes  the  year's  progress  of  a  research  program  that 
will  determine  the  validity  of  quality  metrics  of  digital  imagery  and  relate 
these  metrics  to  image  interpreter  performance  with  both  hard-copy  and  soft-copy 
displays.  Separate  technical  reports  are  issued  to  cover  major  elements  of  work 
under  this  contract.  This  annual  report  simply  summarizes  work  performed  to 
date,  a 


» » 


FORM  lA, 
1  JAN  7J 


EOITION  OF  <  NOV  «S  1$  OBSOLETE 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  PAGE  Oaf*  Cnlotod) 


jj  JUALITY  METRICS  OF  JIIGITALLY  DERIVED  IMAGERY 


. 


AND  THEIR  RELATION  TO  __JNTEEPRET ER 


- 5 


PERFORMANCE  „  > 


J 


^  j  JNNUAL  TECHNICAL  KEP«T  , 


for 


Period  Endingj  JO  Sep 


80 


r  T  - - — *’— ■ * — •> 

'J~~l  Harry  L.^snyUery  Ph.D. 


i  /  t'Zf  g- 


Department  of  Industrial  Engineering 
and  Operations  Research 

Virginia  Polytechnic  Institute  and  State  University 
Blacksburg,  VA  240fa1 


(i&—7 ~ 7 j  :/'£>* 

Contract  F4962jJ-7 8-C-jO05b  /  ' 

U.S.  Air  Force  Office  of  Scientific  Research 
Life  Sciences  Directorate 
Boliinv  *.ir  Force  Base,  D.  C.  20332 


I 


Accession  For 

NTIS  GRAAI 
DIIC  TAB 
Unannounced  □ 

Justification - 


By - — - 

Distribution/ 


Availability  Codes 
Avail  and/or 
Dlst  I  Sfeoial 


k 


r 


n\' 


A 


■  r*  • 


0 


/  / 


I  I 


AIR  FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH  (AfSC) 
NOTICE  OF  TRANSMITTAL  TO  DDC 
This  technical  report  has  been  reviewed  and  is 
approved  for  public  releaso  IAIY  AFR  190-12  ( 7b) • 
Distribution  is  unlimited. 

A.  D.  BLOSE  . y  i  ^  j  1 

Technical  loforaation  Officer  U 0  !  f  j 


TABLE  OF  CONTENTS 


page 

INTRODUCTION  .  1 

Statement  of  the  Problem . 1 

Overview  of  the  Program . 4 

Research  Objectives  .  6 

Specific  Research  Tasks  .  6 

STATUS  OF  THE  RESEARCH . b 

PUBLICATIONS  .  11 

PERSONNEL . 13 

Faculty  .  ...............13 

Research  Associates  ..  .  13 

Graduate  Research  Assistants  .  .  .  14 

INTERACTIONS  .  1b 

DISCOVERIES,  INVENTIONS,  PATENTS  .  17 


OTHER  INFORMATION 


IB 


INTRODUCTION 


Statement  of.  the  Problem 

Recent  technological  developments  have  resulted  in  a  wide 
variety  of  imaging  systems  and  subsystems.  The  flexibility 
and  technology  available  to  the  designer  include  various 
means  for  collecting,  coding,  transmitting,  decoding,  analog 
and  digital  processing,  and  analog  and  digital  display.  The 
applications  of  such  systems  and  subsystems  are  myriad, 
ranging  from  static  and  dynamic  military  photointerpretive 
functions,  througn  commercial  and  closed-circuit  television 
and  facsimile  systems,  to  diagnostic  radiological  instrumen¬ 
tation  and  earth  resources  applications.  The  scientific 
world  is  quite  familiar  with  some  of  the  techniques  which 
can  be  used  to  "improve"  the  nature  of  any  such  image,  ana 
the  non-scientif ic  world  has  equally  seen  examples  of  image 
processing  effectiveness,  such  as  the  Zapruder  and  Hughes 
films  of  the  Kennedy  assassination.  In  many  cases,  it  is 
clear  that  such  processing  and  display  techniques  can 
extract  information  in  the  oriqinal  image  which  is  otherwise 
well  below  the  threshold  capacity  of  the  human  visual  sys¬ 
tem,  whereas  in  other  cases  it  is  quite  clear  that  process¬ 
ing  techniques  can  often  serve  either  to  hide  existing,  and 
important,  image  detail  or  to  "create"  (artif actual)  image 


detail  which  is  perhaps  not  present  in  the  original  image  or 
in  the  “real  world."  Heretofore,  most  of  these  areas  of 
image  system  and  subsystea  developaent  have  plainly  suffered 
froa  their  inattention  o  huaan  observer  requirements.  The 
aost  visible  of  these  deficiencies  is  the  extensive  and 
expensive  developmental  effort  in  digital  image  processing, 
particularly  that  part  devoted  to  the  improvement 
("enhancement, *•  "restoration")  of  images  for  purposes  of 
human  information  extraction.  in  nearly  all  of  the  work 
performed  in  laboratories  around  the  country  that  are  pursu¬ 
ing  this  type  of  research,  the  necessary  evaluative  efforts 
to  determine  the  utility  of  processing  and  display  techni¬ 
ques  have  not  been  conducted.  Rather,  reports  and  publica¬ 
tions  of  this  work  typically  take  the  fora  of  "before  and 
after"  pairs  of  images,  where  the  reader  is  left  to  estimate 
the  utility  of  such  images  either  by  visual  inspection  of 
these  published  (second-  or  third-generation)  photographs  or 
by  the  subjective  opinions  offered  in  the  text  by  the 
author . 

Because  the  intent  of  such  image  processing  techniques  is 
to  improve  the  information  extraction  capabilities  of  the 
human  observer,  it  is  clearly  appropriate  and  mandatory  that 
evaluative  techniques  include  objective  measurement  of  human 
information  extraction  from  such  images,  rather  than  merely 
subjective  estimates  of  the  overall  quality  or  utility  of 
the  image.  Unfortunately,  the  extraordinary  state  of 


affairs  in  this  scientific  realm  is  that  the  human  factors 
experiments  required  to  produce  quantitative  and  objective 
assessment  of  image  quality  have  rarely,  if  ever,  been  mea¬ 
sured  in  image  processing  laboratories  or  in  conjunction 
with  image  processing  programs. 

In  view  of  the  many  millions  of  dollars  being  devoted  to 
image  collection,  processing,  and  display  systems  tor  the 
military  and  civilian  use  of  digitized  images,  it  is  quite 
clear  that  this  assessment  program  is  urgently  needed  to 
devise  procedures,  techniques,  and  metrics  of  digital  image 
quality.  This  program  includes  the  establishment  of  a 
standardized  set  oc  proce  dures  for  obtaining  human  obser¬ 
ver  information  extraction  performance;  relating  this  per¬ 
formance,  in  a  quantitative  manner,  to  the  various  collec¬ 
tion,  processing,  and  display  techniques  and  algorithms;  and 
devising  a  quantitative  relationship  for  the  multidimen¬ 
sional  scaling  of  the  various  collection,  processing,  and 
display  techniques  in  "performance  space." 

Only  through  such  an  integrated  program  of  research  can 
the  system  and  subsystem  designer  have  meaningful  data  for 
cost-benefit  analyses  of  future  system  development,  be  such 
systems  intended  either  for  military  or  tor  non-military 
applications.  The  image  collection,  processing,  and  display 
technology  is  now  at  a  point  whereby  such  evaluative 
research  is  sorely  needed.  Fortunately,  microphotonetnc, 
microdensitometric,  and  human  performance  measurement  tech- 
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nigues  have  been  evolved  during  the  past  several  years  to 
relate  human  information  extraction  performance  to  the  vari¬ 
ous  physical  characteristics  of  both  electrooptical  and  pho¬ 
tographic  inage  displays.  The  present  research  program  will 
greatly  extend  these  recently  developed  techniques  into  the 
area  of  digital  images,  emphasizing  derivation  of  metrics  of 
image  quality  appropriate  to  digitized  images,  and  providing 
quantitative  data  which  will  permit  the  designer  and  system 
developer  to  plan  his  developmental  effort  as  well  as  to 
specify  optimum  system  components  for  particular  image 
acquisition  and  display  requirements. 

Overview  of  the  Program 

The  research  plan  is  laid  out  schematically  in  Figure  1. 
Each  small,  solid-lined  box  in  Figure  1,  with  the  exception 
of  the  uppermost,  indicates  a  separate  task  to  be  conducted 
during  the  course  of  the  effort.  The  two  large,  broken- 
lined  boxes  delineate  the  specific  display  formats  that  will 
be  studied  and  compared  during  the  initial  program:  black- 
and-white  hard-copy  transparencies  and  electronic  (soft- 
copy)  displays.  The  small,  broken -lined  box  at  the  bottom 
illustrates  important  extensions  of  this  research  to  be  pur¬ 
sued  in  the  future,  namely  interactive  digital  displays  in 
both  black-and-white  and  full  color. 


4  - 


Egggltgfe  Objectives 


The  research  objectives  of  this  prograa  are  as  follows: 

1.  Develop  standardized  procedures  and  techniques  to 
evaluate  hard-copy  (fill)  and  soft-copy  (CRT) 
digital  iaage  quality. 

2.  Coapare  candidate  physical  aetrics  of  iaage  qual¬ 
ity. 

3.  Coapare  hard-copy  with  soft-copy  displays  for 
iaage  interpretation. 

4.  Evaluate  candidate  processing,  enhanceaent,  and 
restoration  algorithas  for  iaproveaent  of  iaage 
interpretation  on  soft-copy  displays. 

To  achieve  these  objectives,  the  prograa  is  broken  into 
13  interrelated  tasks,  which  are  listed  below. 

§E8£ili£  Bassflis h  la&Bs 

In  keeping  with  the  general  goals  described  above,  the 
specific  research  tasks  are  as  follows: 

1.  Develop  an  iaagery  data  base  and  iaage  intepreta- 
tion  scenarios  froa  high  quality  aerial  photogra¬ 
phy  relevant  to  the  iaage  interpretation  task. 

2.  Select  and  purchase  display  and  interface  hardware 
to  present  the  iaage  data  base  on  soft-copy  (CRT) 
displays. 
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).  Develop  iaage  aanipulation  software  for  soft-copy 
and  hard-copy  experiments. 

I.  Develop  and  standardize  observer  data  collection 
procedures  for  hard-copy  and  soft-copy  experi- 
aents. 

i.  Develop  and  standardize  procedures  for  obtaininq 
physical  iaage  aetrics  fcoa  hard-copy  and  soft- 
copy  displays. 

b.  Digitize  and  degrade  data  base  iaagery  and  record 
iaages  on  hard  copy  and  aagnetic  tapes  for  soft- 
copy  display. 

7.  Obtain  physical  iaage  aetric  data  for  hard-copy 
and  soft-copy  displays. 

9.  Conduct  subjective  quality  scaling  and  inforaation 
extraction  studies  on  hard-copy  iaages. 

9.  Conduct  subjective  scaling  and  inforaation  extrac¬ 
tion  studies  on  soft-copy  displays. 

10.  Evaluate  the  utility  of  iaage  quality  aetrics  for 
both  hard-copy  and  soft-copy  iaagery. 

II.  Conduct  subjective  scaling  and  inforaation  extrac¬ 
tion  studies  on  processed  soft-copy  iaagery. 


12. 


i 

j 

i 

1 

Analyze  utility  of  inage  quality  aetrics  for  pro¬ 
cessed  soft-copy  iaagery. 


13.  Coapare  iaage  quality  aetrics  for  hard-copy  and 
soft-copy  (processed  and  nonprocessed)  iaages. 
Relate  these  results  to  concepts  and  aodels  of 
huaan  visual  perforaance  and  to  iaaging  systea 
design  variables. 
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sntgs  OF  XM  RESEARCH 


Each  of  the  13  research  tasks  is  listed  in  Table  1,  along 
with  scheduled  and/or  actual  coapletion  dates. 

In  general,  the  research  is  on  schedule.  Tas)c  1  through 
Task  U  are  coaplete.  That  is,  preparation  for  and  conduct 
of  all  hard-copy  studies  are  coaplete,  and  technical  reports 
relating  to  these  studies  are  in  the  final  stages  of  prepa¬ 
ration  and  review.  It  is  anticipated  that  these  reports 
will  be  published  and  distributed  by  31  Harch  1981.  Prepa¬ 
ration  is  largely  coaplete  for  the  soft-copy  study  dealing 
with  non-aodified  iaagery,  and  data  collection  for  this 
study  should  begin  approxiaately  15  Harch  1981,  and  should 
be  concluded  by  30  July  1981.  Thus,  Task  9  should  be  coa- 
pleted  ahead  of  schedule,  and  Task  10  should  be  coapleted  at 
least  on  schedule. 
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TABLE  1 


Schedule  and  Status 


Task 

Scheduled 

Completion 

Status  or 

Actual  Completion 

1.  Data  base  and  scenario 
development 

March  1979 

June  1979 

2.  Display  and  interface 
hardware 

March  1979 

March  1979 

3.  Image  manipulation  software 

Sept.,  1979 

June  1980 

4.  Observer  data  collection 
procedures 

January  1980 

January  1980 

5.  Procedures  for  quality 
metrics  measurement 

June  1980 

June  1980 

6.  Digitize  and  record 
data  base 

July  1980 

July  1980 

7.  Image  guality  measurements, 
hard-  and  soft-copy. 

August  1980 

December  1980 

8.  Hard-copy  studies 

Sept.,  1980 

September  1980 

9.  Soft-copy  studies 

Dec.,  1981 

to  begin  March  1981 

10,  Quality  metric  evaluation 

Dec.,  1981 

to  begin  June  1981 

11.  Processed  soft-copy 

July  1982 

12.  Quality  metrics  for 
processed  soft-copy 

October  1982 

13.  Summary  analyses 

Dec. ,  1982 

10 


Several  publications  are  currently  in  progress.  The 
first  technical  report  to  be  issued  (draft  January  1981) 
vill  summarize  the  data  collection  process  and  results  of 
the  information  extraction  study  of  the  hard-copy  imagery. 
The  second  major  technical  report  will  describe  the  experi¬ 
mental  process  and  summarize  the  results  of  the  quality 
scaling  experiment  of  the  hard-copy  imagery.  Together, 
these  two  reports  summarize  the  work  leading  up  to  and 
including  Task  8.  In  addition,  a  separate  Technical  Report 
vill  summarize  the  preparation  of,  measurement  of,  and  con¬ 
tent  of  the  imagery  data  base  (Tasks  1,  3,  5,  and  6).  The 
draft  of  this  report  will  be  submitted  to  AFOSR  for  review 
by  the  end  of  February,  1981.  A  separate  Technical  Report, 
to  be  completed  by  the  end  of  flay,  1981,  will  describe  the 
system  for  display,  manipulation,  and  data  collection  with 
soft-copy  displays.  While  this  is  not  called  for  as  a  sepa¬ 
rate  Technical  Report  in  the  Statement  of  Work,  it  is 
believed  that  this  particular  publication  will  be  very  use¬ 
ful  for  others  conducting  research  in  this  area,  and  vill 
serve  as  a  documentary  basis  for  future  studies  with  the 
soft-copy  imagery.  Separate  Technical  Reports  dealing  with 
the  soft-copy  studies  conducted  during  the  Barch-June  1981 


tiae  fraie  will  be  coipleted  in  draft  fori  by  the  end  of 
September,  1981,  and  submitted  to  AFOSB  at  that  tile. 
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OTHER  INFORMATION 


The  major  technical  hurdles  during  the  past  year  were  the 
development  of  a  suitable  imagery  data  base  and  the  collec¬ 
tion  of  photointerpreter  performance  and  scaling  data  with 
that  data  base.  While  significant  technical  problems 
existed,  all  were  acceptably  surmounted  and  the  effort  was 
completed  on  schedule  and  with  satisfactory  results.  These 
technical  issues  and  the  results  are  contained  in  separate 
technical  reports. 
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